Papers with human alignment methods
A Practical Analysis of Human Alignment with *PO (2025.findings-naacl)
Copied to clipboard
| Challenge: | Prior research focused on identifying the best-performing method to varying hyperparameters . prior research focused primarily on a grid search, which can be impractical for general practitioners . |
| Approach: | They propose a preference optimization method that is more stable across hyperparameters and reduces the average response length. |
| Outcome: | The proposed method increases likelihood of achieving better results through various metrics, such as KL divergence and response length. |
Enhancing Persona Consistency for LLMs’ Role-Playing using Persona-Aware Contrastive Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for analyzing and analyzing large language models (LLMs) lack of emotion and fine-grained role awareness limits the model’s ability to provide personalized and diverse interactions further. |
| Approach: | They propose an annotation-free framework to align LLMs’ behavior during role-playing, enhancing the model’s role consistency. |
| Outcome: | The proposed framework outperforms vanilla LLMs under automatic evaluation methods and human expert evaluation. |